Enabling Real-time, Scalable and Secure Collaborative Intelligence on the Edge

Funded by the National Science Foundation

PI: Zheng Dong       Co-PI: Weisong Shi


Abstract

With the proliferation of embedded systems, multicore computing devices enable the recent trend of moving computation from the centralized cloud to distributed edge platforms. This trend yields new products and services across smart infrastructures in smart cities. However, as real-time workloads are executed at the edge computing platforms, the performance bottleneck is transferred from the edge-cloud communication to on-chip communication. The system’s real-time performance faces new system-architectural challenges for the Network-On-Chip (NoC), which are scalability and security. These challenges are hinged with dynamic data distributions across different users. This project aims to design a real-time and scalable NoC for implementing real-time collaborative learning algorithms. The key strategy is to orchestrate a system-architecture and algorithm co-design to explore the new design space on the edge computing platform.

To cope with the research challenges, a comprehensive architecture will be developed to address these multifaceted problems through a hardware and software co-design, which consists of three key thrusts: (i) designing an interconnect, which will eliminate non-predictability barrier on the NoC; (ii) establishing a scalable virtualized transaction environment for the collaborative learning system to guarantee that all the real-time transaction tasks can complete at the right time; (iii) implementing a real-time and secure multi-target tracking system on the edge platform in light of the newly proposed architecture. The proposed research will be evaluated using the physical platform Equinox, with indoor and outdoor studies beyond simulation.

This research will open a new dimension of research and educational opportunities. In particular, the success of the project will provide a hardware/software package that can enhance the real-time collaborative computing on the edge. The resulted interconnect and Equinox are ready-to-use platforms that will allow experts/researchers to easily examine their research designs regarding collaborative learning and real-time edge computing, thereby sealing the gap between different research fields. Educational efforts will be devoted to (i) curriculum design for the undergraduate and graduate program, (ii) summer camp development for middle and high school students, and teachers, (iii) broadening participation in computing and engineering, at the Wayne State University.



Key Publications

  • Zheng Dong and Cong Liu, Schedulability Analysis for Co-Scheduling Real-Time Tasks on Multiprocessors, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems (TCAD), accepted.
  • Zhe Jiang, Kecheng Yang, Neil Audsley, Nathan Fisher, Weisong Shi, and Zheng Dong, BlueScale: A Scalable Memory Architecture for Predictable Real-Time Computing on Highly Integrated SoCs, Proceedings of the 59th ACM/IEEE Design Automation Conference (DAC), July 2022.
  • Zhe Jiang, Kecheng Yang, Nathan Fisher, Ian Gray, Neil Audsley, and Zheng Dong, AXI-ICRT: Towards a Real-Time AXI-Interconnect for Highly Integrated SoCs, IEEE Transactions on Computers (TC), 2022.
  • Zheng Dong, Yan Lu, Guangmo Tong, Yuanchao Shu, Shuai Wang and Weisong Shi, WatchDog: Real-time Vehicle Tracking on Geo-distributed Edge Nodes, ACM Transactions on Internet of Things (TIOT), 2022.
  • Zhe Jiang, Kecheng Yang, Nathan Fisher, Neil Audsley, and Zheng Dong, Towards an Energy-Efficient Quarter-Clairvoyant Mixed-Criticality System, Journal of Systems Architecture (JSA), 2022.
  • Liangkai Liu, Zheng Dong, Yanzhi Wang and Weisong Shi, Prophet: Realizing a Predictable Real-time Perception Pipeline for Autonomous Vehicles, Proceedings of the 43rd IEEE Real-Time Systems Symposium (RTSS), 2022.
  • Zheng Dong and Cong Liu, A Utilization-based Test for Non-preemptive Gang Tasks on Multiprocessors, Proceedings of the 43rd IEEE Real-Time Systems Symposium (RTSS), 2022.
  • Zhe Jiang, Kecheng Yang, Yunfeng Ma, Nathan Fisher, Neil Audsley, and Zheng Dong, Towards Hard Real-Time and Energy-Efficient Virtualization for Many-core Embedded Systems, IEEE Transactions on Computers (TC), 2022.
  • Zhe Jiang, Nathan Fisher, Nan Guan and Zheng Dong, BlueFace: Integrating an Accelerator into the Core's Pipeline through Algorithm-Interface Co-Design for Real-Time SoCs, Proceedings of the 60th Design Automation Conference (DAC), July 2023.
  • Last modified 01 January 2022